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ABSTRACT 


The purpose of this thesis is to identify and analyze problems in the selection process 
of Korean Navy students to attend NPS, as well as to suggest a selection model that 
allows for channeling of high-potential Korean Navy officers into NPS in a way which 
is least expensive to the Navy and most appropriate for officer professional develop- 


ment. 
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I. INTRODUCTION 
A. INTRODUCTION 


The rate of expansion of the Korean Navy in the past few years, along with the 
purchase of modern material and highly advanced weapon systems, has caused this or- 
ganization to require competent human resources capable of coping with a high work 
load and increasing technological sophistication. One implication has been the need for 
officers capable of efficiently managing these valuable people and material resources. 
As a result, the military has begun to educate some of its officers in the field of occu- 
pational codes. 

In the past decades, a number of Korean Navy officers have been sent to NPS 
(Naval Postgraduate School) for postgraduate programs working towards a masters de- 
gree. Especially, in the last ten years, the number of Korean Navy students at NPS has 
been greatly increased compared with the earlier years. 

The Korean Navy sends more than 50% of its overseas postgraduate students to 
NPS. Therefore, the Korean Navy selection process for NPS is very important to the 
future of the Korean Navy. | 

Presently, the selection process has some problems in determining who attend and 
which curriculum they will study. The majority of students are all in limited curricula and 
occupational codes. This often excludes some occupational codes. Other vital curricula 
are under-represented. This policy limits the exposure of a wide variety of officers to 
various important curricula that could play a key role in the effectiveness of the Korean 
Navy. 

The selection is very important to organizational effectiveness. The Navy personnel 
department wants to make careful, informed choices. These decisions should be based 
on relevant information that 1s not too costly or time-consuming to collect. Selecting 
the wrong students causes valuable training time and money to be spent on the wrong 
students, makes supervisors waste time on subordinates who cannot or will not perform 
well no matter how skillfully managed, and demotivates co-workers who do not get their 
needs met. In this phase, a good system for selecting Korean Navy students to attend 
NPS must be designed to facilitate the successful completion of NPS education and in- 
crease potential benefits for the military organization through the selection of highly 


qualified officers as the candidates. 


The purpose of this thesis is to identify and to analyze problems in the selection 
process of Korean Navy students who attend NPS, as well as to suggest a selection 
model that allows for channeling high-potential Korean Navy officers into NPS in a 
way which is least expensive to the Navy and most appropriate for officers’ professional 


development. 


B. OUTLINE 

Chapter II provides an overview of the selection process literature. Chapter III re- 
views the current Korean Navy selection process and problems. Chapter IV analyzes 
the current selection process. Chapter V introduces an effective model for the NPS se- 


lection process. Chapter VI summarizes the conclusions of this study. 


II. LITERATURE 


Personnel selection is the process of determining whether candidates who have been 
recruited have the necessary qualifications for the specific job openings and of choosing 
those persons who best fit the job requirement or specifications. {Ref. I: P. 135] 

The personnel selection process largely determines the future of an organization for 
it provides not only the people to perform current jobs, but also a “pool” of available 
personnel from which promotions develop the institution’s future leadership position. 
eee 2: P. 192) 

The selection process involves mutual decision making. The organization decides 
Whether or not to make a job offer and how attractive the offer should be. The job 
candidate decides whether the organization and the job offer will fit his or her needs and 
Ba@aise| Ref. 3: p. 535] 

Figure 1 shows how the selection procedure is related to the other phases of se- 


lection. 


Personnel- Recruiting Selecting Placing 
human resource needed qualified New employees 


planning personnel ' persons on joo 





Figure 1. How the Selection Procedure Fits into the other Procedures 


A. SELECTION MODEL 


The process of making an informed hiring decision depends largely on two basic 
principles of selection. The first principle is that past behavior is the best predictor of 


future behavior. Knowing what an individual has done in the past 1s the best indication 
of what the individual is likely to do in the future. This principle is not deterministic; an 
emplovee who has been outstanding in previous jobs may only be mediocre in a new 
position. 

The second basic principle of employee selection is that the organization should 
collect as much reliable and valid data as is economically feasible and then use it to select 
the best applicants. Reliable data refers to information that is repeatable and consistent. 
Valid data refers to information that indicates how well employees will perform their 
jobs. [Ref. 4: P. 201] 

The performance of the selection function is based upon the assumption that it 1s 
possible to find potential employees with the proper combination of personal charac- 
teristics required for the successful performance of given jobs. The second assumption 
is that sufficient valid information can be obtained about the applicants in order to make 
a valid employment decision. Although these assumptions are not entirely accurate, at 
least they are valid approximations that will have to suffice until a more “scientific” ap- 
proach is found. For now, selection involves matching the candidate’s personal quali- 
fications with the specified requirements of the job. [Ref. 2: p. 194] 

The personnel selection model 1s presented in figure 2. The classic selection model 
is based on individual differences. It tries to select those people who have the greatest 
number of attributes deemed important for job success. [Ref. 5: p. 208] 


{. Job Analysis 

Job analysis can be defined as the process of gathering pertinent information 
and determining the component elements of a job by observation and study. Job analysis 
records details concerning training, skills, required efforts, qualifications, abilities, expe- 
riences, responsibilities, and so forth, which are needed for the job. In essence, it evalu- 
ates the qualitative demands of a job and is the procedure used when a job 1s studied for 
any of the following purposes: recruitment and placement of employees; classification 
and evaluation of present emplovees; establishment of performance standards; and job 
evaluation. [Ref. 2: p. 151] 

For both recruitment and selection, job analvsis 1s a tool which provides im- 
portant basic information about the job requirements based on a careful study and de- 


scription of the actual duties of the position. 


Analysis of job 
Y 
Measure performance Measure performance 
on the criterion Step 3 on the predictor 


Assess relationship between 
criterion and predictor 


If relationship is good, if relationship is bad, 
assess utility of predictor reject the predictor 
Periodically repeat . . 
Try different predictor 


Figure 2. The Classic Selection Model 





Bv inference, at least, job analysis can also provide information about the characteristics 
of people who might perform the job most successfully. Two major products of job 
analysis, then, are job descriptions and statements of worker qualifications. [Ref. 6: p. 


4-23] 


2. Selection of Criterion and Predictors 


a. Criteria 
Criteria are best defined as evaluative standards; they are used as reference 
points in making judgements. Criteria are most important for defining the “goodness” 


of employees, programs and units of the organization as well as the organization itself. 


What should criteria be like? This listing by Blum and Naylor (1968) 1s most 
representative: 


1. Reliable 

Realistic 

Representative 

Related to other criteria 

Acceptable to the job analyst 
Acceptable to management 

Consistent from one situation to another 
Predictable 


CPN Dw Bw ND 


Inexpensive 


—" 
S 


Understandable 


—_— 
— 


Measurable 


— 


Relevant 
13. Uncontaminated and bias free 


14. Sensitive 


This list might be reduced to three general factors: Criteria must be ap- 
propriate, stable, and practical. They should be relevant and representative of the job. 
They must endure over time or across situations. Finally, they should not be too ex- 
pensive or difficult to measure. 

Other authors (e.g., Weitz, 1961) think that other issues are important; for 
example, the time at which criterion measures are taken (after one month, six months 
on the job, etc.); the type of criterion measure taken (performance, errors, accidents, 
etc); and the level of performance chosen to represent success or failure on the job (e.g., 
college students must perform at a C level before they can graduate). Weitz savs the 
choice of criteria is usually determined by either history or precedent; but unfortunately, 


sometimes criteria are chosen because they are merely expedient or available. (Ref. 5: p. 
99] 


b. Predictors 


A predictor is any variable used to forecast a criterion. Personnel selection 


methods conceivably could be evaluated by many standards. 


The first is validity, which refers to the predictor’s capacity to accurately 
forecast criterion performance. Many authorities would argue that validity is the pre- 
dominant evaluative standard in judging selection methods; however, the relevance of 
the other three standards is also substantial. 

The second standard is fairness, which refers to the predictor’s ability to 
render unbiased predictions of job success across applicants in various subgroups of sex, 
race, age and so on. 

Applicability is the third standard and refers to whether the selection 
method can be applied across the full range of job and applicant types. Some predictors 
have a wide applicability in that they appear well suited for a diverse range of people and 
jobs. Other methods have peculiar limitations that reduce their applicability. 

The final standard refers to the cost of implementing the method. The vari- 
ous personnel selection methods differ markedly in their cost, which has a direct bearing 


on their overall value. [Ref. 5: p. 162] 


c. Determining Selection Criteria 

To be most successful in selecting the right person for the right job, the 
personnel manager needs to determine through research which personal variables are the 
best predictors of performance for specific jobs, establish these as the characteristics to 
be sought in prospective employees, and then design a selection procedure which will 
enable one to ascertain to what extent a given applicant possesses them. It is possible 
to design a rating scale which can be used to evaluate applicants successfully if the exact 
requirements of the job are known, if the degree of importance of each requirement to 
the total position is known, and the accuracy of the predictive variables are validated. 

Figure 3 shows some of the personal characteristics most frequently sought 
in prospective employees, along with the step(s) in the selection procedure where infor- 


mation about the trait is sought. [Ref. 1: p. 271] 


Some words of caution are in order relative to seeking out these items of 
information. First, the details of some of this information may be in violation of public 
policy, especially if used in conjunction with other data or criteria in such a way as to 
suggest prima facie evidence of intent to discriminate against any of the protected 


groups. 


Personal characteristics 
needed to perform job 
adequately 


Personal background 


Aptitudes and interests 


Attitudes and needs 


Analytical abilities 


Skills and technical abilities 


Health, energy, and stamina 


Value system 


Sources of information 
upon Which to evaluate 
if characteristc is present 


Application blank 
Preliminarv interview 
School records 
References 
Diagnostic interview 


Application blank 
School records 
Psychological tests 
References 
Interviews 

Work records 


Interviews 
Psychological tests 
References 


School records 
Psychological tests 
Diagnostic interview 
Work references 


School records 
Training records 
Interviews 

Work references 
Performance tests 


Medical examination 
Diagnostic interview 
W ork reference 


References 
Diagnostic interview 


Figure 3. Personal Characteristics sought in Prospective Employees and Source of 


Information about Them 


Second, as no individual will possess all qualities considered to be desirable as they will 
not appear in the proper quantity and quality sought, an acceptable combination of 


maximum and minimum cutoff points should be predetermined. Finally, a criterion 


which is generally accepted at one point in time may prove to be arbitrary or indefensible 


at another time or place. [Ref. 2: p. 201] 


3. Measuring Performance 
Criterion or job performance data can be collected in either a concurrent or 
predictive validity design. The difference between these two research designs has been the 
topic of much discussion in personnel selection research. The major distinction between 
concurrent and predictive criterion-related validity is the time interval between collection 


of the predictor and establishing criterion data. [Ref. 5: p. 210] 


a. Concurrent Validity 
This is sometimes referred to as the present-employee method. In effect, 
it is the extent to which the results obtained with a selection technique (such as a test) 
are Statistically related to the performance of employees currently on the job. This ap- 
proach permits the immediate determination of the usefulness of that selection instru- 
mem | Ref. 5: p. 220] 

This design has been criticized on several points: (1) Test scores are ob- 
tained from individuals already employed in the job, therefore, the results may not apply 
to the applicants objectively. (2) It is possible that current employees change by devel- 
oping particular skills necessary for success on the job. (3) Job incumbents may also re- 


spond differently while taking the tests than job applicants. [Ref. 7: p. 33] 


b. Predictive Validity 

This validity, sometimes referred to as the follow-up method, 1s arrived at 
by using the selection technique on all applicants who apply for the job. As the instru- 
ment itself is being tested, acceptances or rejections should not be made on the basis of 
the results (“scores”) , but hiring decisions should be made on the basis of other selection 
techniques. After the new employees have been on the job sufficiently long enough to 
obtain a true measure of their performance, a statistical correlation 1s prepared between 
their earlier “scores” on the instrument and the criterion used to obtain a true measure 


of successful performance. [Ref. 5: p. 220] 


4. Assessing the Predictor’s Validity 
This is to determine if differences in predictor scores correspond with differ- 
ences in criterion scores; that is, does the predictor have validity? This procedure is done 
with statistical analysis, in most cases by computing a correlation coefficient. If the 
predictor has validity, there will be some appreciable relationship between predictor 
scores and criterion scores. If the predictor is lacking in validity, there will be no corre- 


spondence between the sets of scores. [Ref. 5: p. 209] 


5. Determining the Predictor’s Utility. 

The utility of a predictor is the degree to which its use improves the quality of 

the people being selected beyond what it would have been had that predictor not been 
used (Blum & Naylor,!1968). [Ref 5: p. 195] 


a. Criterion Reliability 
The measures of job performance against which a predictor is validated 
must be stable. Stabilty in the criterion is imperative. It means little to talk about “av- 


erage” job performance when performance fluctuates widely. 


b. Criterion Relevance 
Criterion relevance is the degree to which the actual and conceptual criteria 
coincide. The greater the match between them, the greater the criterion relevance. [Ref. 
5, prs li 
It is important that the actual criterion selected to represent the conceptual 
criterion of job performance be an appropriate measure. The utility of a predictor is 
gauged by the improvement in the quality of the people being hired, so the criterion 


must be an accurate indicator of quality. [Ref. 8: p. 196] 


c. Predictor Reliability 
The greater the validity of the predictor, the greater its utility as measured 
by the increase in average criterion performance for the accepted group over that for the 


total group. 


10 


ad. Selection Ratio 
The selection ratio is defined as the number of job openings(n) divided by 
the number of job applicants(N), or 


When the SR is equal to 1 (there are as many openings as there are applicants) or 
greater ( there are more openings than applicants), the use of any selection device has 
little meaning. [Ref. 5: p. 198] 

The relationship between SR and predictor utility should be clear: The 
smaller the SR, the greater the predictor’s utility or value. This should also make sense 
intuitively. The fussier we are in admitting people (i.e., the smaller the selection ratio), 
the more likely it is that the people admitted (or hired) will be of the quality we desire. 
ixer .: p. 199] 


e. Base Rate 

The base rate of success refers to the percentage of employees that can be 
considered successful without the use of the new predictor. The relationship between the 
base rate and predictor utility is somewhat deceptive, since it depends on the way gains 
in average criterion performance are viewed. The possibility for the largest potential 
gain in criterion performance (in a relative sense) occurs for low base rates. However, in 
absolute terms, the largest gains in average criterion performance will occur with a base 
rate of .50; that is, a new predictor will produce the greatest increase in the number of 


people who will attain satisfactory performance if the base rate is .50. [Ref. 5: p. 201] 


f. Cost 

All other things being equal, the predictor that costs the least to administer 
has the greatest utility. In many cases, however, all other things are usually not equal. 
For example, sometimes the most valid predictor also costs the most money to admin- 
ister or score. The increases in validity usually compensate for any increases in cost - 
unless, of course, the predictor is prohibitively expensive. Predictor validity has the 
greatest impact on utility, so in almost all cases, a more valid predictor 1s worth it. [Ref. 

598201) 
The greatest utility will occur when the predictor is highly valid, the se- 


lection ratio is low, the base rate is .50 and the cost of the predictor 1s low. 
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6. Reanalysis 
Over time, jobs can be changed, applicant pools can be altered, predictors can 
lose validity and invalid predictors can be periodically reevaluated to see if changing 
employment conditions have altered the predictor-criterion relationship. This should be 


done at least every five years. [Ref. 5: p. 210] 


B. GATHERING INFORMATION ABOUT POTENTIAL EMPLOYEES 


1. Application Form 
The application form serves three purposes. First, it formally indicates that the 
applicant desires a position. Second, it provides the interviewer with the basic informa- 
tion he or she needs to conduct an interview. Third, it becomes a part of the organiza- 


tion’s personnel information if the applicant 1s hired. [Ref. 3: p. 535] 


2. Preliminary Interview 
The initial screening interview is used to make a quick evaluation of the appli- 
cant’s suitability for the particular job. In effect, the initial interview determines for both 
the applicant and interviewer whether or not the selection process should proceed. The 
preliminary interview is designed to eliminate individuals who are obviously disqualified 
because of poor appearance, physical disability, unavailability for employment, lack of 


serious interest in the job or the oppprtunity it provides and so forth. [Ref. 3: p. 535 536] 


3. Testing 
It has been noted that one of the essential aspects of selection involves the as- 
sessment of differences in abilities, aptitudes and personality characteristics that exist 
among job applicants. [Ref. 1: p. 145] 
Through testing, the organization attempts to judge the candidate’s capacity to 
learn on the job or whether the candidate has the skills needed. [Ref. 3: p. 536] 


4. Background Investigation 
In a background investigation, the truthfulness of a candidate’s resume or ap- 
plication form will be checked, and further information will be sought from one or more 


of the candidate’s references or previous employers. Such an investigation is useful, since 
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studies have shown that as many as half of the applications submitted contain false or 


erroneous material. [Ref. 3: p. 537] 


5. In-depth Selection Interview 

The in-depth selection interview is designed to fill in gaps on the candidate’s 
application or resume; find out more about the applicant as an individual; and, in gen- 
eral, obtain information of interest to the interviewer so that the suitability of the can- 
didate for the job and the organization can be determined. Unlike the screening 
interview, which 1s usually conducted by a member of the personnel department, the in- 
depth interview is usually conducted by the manager to whom the candidate would re- 
pene mired. [Ref. 3: p. 537] 


6. Physical Examination 
The physical examination is designed to ensure that the candidate can perform 
effectively in the position for which he or she is applying, to protect other employees 
against contagious disease, to establish a health record for the applicant and to protect 


the organization against unjust worker’s compensation claims. [Ref. 3: p. 537] 


C. SELECTION DECISION 


I. Selection Strategies 


a. Multiple Regression 
The multiple regression selection strategy is based on the statistical proce- 
dure of multiple regression analysis. This method involves the use of two or more pre- 
dictors weighted and added together to enhance the prediction of criterion. Using a 


two-predictor model and assuming a=0, the multiple regression equation would be 
= bX, i bX, 


This approach assumes that (1) there is a linear relationship between the predictors and 
the criterion (i.e., higher scores on the predictor will lead to higher scores on the crite- 
rion) and (2) having a lot of the attributes measured by one predictor compensates for 


having only a little of the attributes measured by the second predictor. While the former 


assumption (linearity) is usually met, the latter assumption (compensating predictors) is 


a more serious limitation. [Ref. 5: p. 212] 


b. Multiple Cutoff 
The multiple cutoff selection strategy is an alternative to the multiple re- 
gression strategy. The multiple cutoff method is limited by neither a linear relationship 
between predictors and criterion nor the problem of compensating predictors. This 
straightforward and uncomplicated method assumes that a minimal amount of ability 
On all predictors is needed for job success. Minimal passing score cutoffs are set for each 
predictor. If an applicant is below the cutoff on any predictor, he or she is rejected. All 
applicants who have scores at or above the cutoff are hired. Having a high score on one 
predictor cannot compensate for having a low score on another. [Ref. 5: p. 213] 
The multiple cutoff system assumes that compensation is not possible. 
Instead, this system assumes that there is a minimum level of each trait which a person 
must have in order to succeed on the particular job. Using the multiple cutoff system 
requires that a minimum value, a cutoff, be established for each predictor. In order for 
an applicant to be hired, he must be above the cutoff for every predictor. [Ref. 9: p. 184] 
The advantages of the multiple cutoff technique are that there are no limit- 
ing assumptions and the method is easy to use. No formulas are involved in determining 
who passes and who fails. The major obstacle involves determining the cutting scores. 
Cutting scores are generally set by trial and error, with different ones set for each pre- 
dictor. However, it is quite difficult to establish the validity of cutting scores with con- 
current validation procedures when no one in the company hired with the method would 
have any scores below it. Thus, if it were felt that the cutoff were set too high, it would 
be difficult to assess the effect of lowering them on job performance. This restriction in 
range problem is not limited to just the multiple cutoff method, however; it effects all 
concurrent validity studies. [Ref. 5: p. 213 214] 


c. Multiple Hurdle 
In the multiple hurdle strategy, applicants must get satisfactory scores on 
a number of predictor variables (or hurdles) that are administered over time. The suc- 
cessful applicant is one who passes each hurdle and is thus ultimately hired. The multiple 
hurdle approach is not used very often. But when it is used, it is found most frequently 


in management training programs and in the military. First, people who meet certain 
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basic requirements are chosen to comprise a pool of applicants. The first hurdle is de- 
signed to eliminate the least qualified applicants. At various points in time, additional 
hurdles are presented. To survive in the program, applicants must pass each hurdle; 
those who do not are dropped along the way. 

The advantage of the program is that unqualified people do not have to 
endure an entire evaluation program before they are rejected. It is best for both the 
company and the applicant to discover as soon as possible if he or she will not make it 
on the job. Because many evaluations are made, the company can be more confident in 
the quality of their final decision. The disadvantages of the method are the time and cost 
molved, {Ref. 5: p. 217] 


dad. Profile Matching 

In this method, all the current employees take a number (k) of predictor 
tests. Test scores are correlated with measures of job performance. Of the k tests that 
were administered, a subset of them (n) would probably show relationships to job suc- 
cess or be valid predictors. 

Two analyses are used to determine the degree of match between the appli- 
cant’s profiles and the standard profile. What complicates the picture is that sometimes 
the two analvses yield different conclusions about whom to hire. One approach Is to 
simply correlate the applicants’ scores on the predictors with the average company 
scores and then hire the person whose scores correlate the highest. While this may seem 
sensible, there is one problem. Correlation is a measure of the degree of relationship 
between two variables. While two sets of scores mav correlate highly, there may be vast 
differences in their magnitude. An applicant whose profile is similar to the standard but 
whose scores are well below it in terms of magnitude would appear to be a good candi- 
date. Correlation reflects the similarity of the shape of the two profiles but not the de- 
gree of closeness. The second analytical procedure is to compute a measure of the 
differences between the applicants’ scores and the standard scores. The difference (d) 1s 
computed between each predictor and the standard. The differences are squared (d) so 


that the positive and negative difference scores are added together. [Ref. 5: p. 217] 
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2. Selection Errors 


a. Criterion Cutoff 
Criterion cutoff is the point that separates successful (above) from unsuc- 
cessful (below) employees. Again, management decides what constitutes successful and 
unsuccessful performance. Part (a) of Figure 4 shows a predictor-criterion relationship 


of about .80 where the criterion score has been separated by a criterion cutoff. 


b. Predictor Cutoff 
Predictor cutoff is the point that separates accepted (right) from rejected 
(left) applicants. The score that constitutes passing the predictor test is determined by 
the selection ratio, cost factor, or occasionally, the law. Part (b) shows the same 
predictor-criterion relationship, except this time the predictor scores have been seperated 


by a predictor cutoff, 


c. Both Cutoff on a Predictor-Criterion 
Part (c) shows the predictor-criterion relationship intersected by both 
cutoffs. Each of the resulting four selections of the area is identified by a letter repres- 


enting a different group of people: 


(1) Selection A. Those applicants who are above the predictor cutoff 
and above the criterion cutoff are true positives. These are the people we think will 
succeed on the job because they passed the predictor test who in fact do turn out to be 
successful employees. This group represents a correct decision - We correctly decided to 
hire them. 

(2) Selection B. The people in this group are those we thought would 
not succeed on the job because they failed the predictor test and who, if hired anyway, 
would have performed unsatisfactorily. This group represents a correct decision- we 
correctly predicted they would not succeed on the job. These people are true negatives. 

(3) Selection C. Those people who passed the predictor test (and are 
thus predicted not to succeed on the job) but who would have succeeded had they been 
given the chance are called false negatives. We have made a mistake in our decision- 


making process with these people. They would really turn out to be good employees, but 


we mustakenly decided they would not succeed. These are “the good ones we let get 
away.” 

(4) Selection D. Those people who passed the predictor test (and are 
thus predicted to succeed on the job) but perform unsatisfactory after being hired are 
called false positives. We have also errored with these people. They are really ineffective 
employees who should not have been hired, but we mistakenly thought they would suc- 
ceed. They are “the bad ones we let in.” Positive/negative refers to the result of 
passing/ failing the predictor test; true/false refers to the quality (good/bad) of our deci- 
sion to hire the person. In personnel selection, We want to minimize the false positives 


and false negatives. [Ref. 5: p. 203] 
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Figure 4. Effect of Establishing Cutoffs on a Predictor 
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Areas A and B represent correct decisions, because in both cases the 
predictor cutoff was confirmed by later job performance. That is, persons in area A were 
predicted to perform satisfactorily on the job and they did; persons in area B were pre- 
dicted to perform unsatisfactorily on the job and they did. Individuals in areas C and 
D, however, were inncorrectly categorized. Those in area D were predicted to succeed 
on the job, but did not (some may have “washed out” in training), and those in area C 
were predicted to fail on the job, but they performed satisfactorily. 

One index of decision-making accuracy, therefore, is the proportion 
of total decisions made that are correct decisions. In terms of Figure 4, such a propor- 


tion may be computed as follows: 


A+B 


EC ci EGE 


(4 
where PC,,, is the proportion of total decisions that are correct, and A, B, C, and D are 
the numbers of individuals in each cell of Figure 4. The eqation (4-1) takes into account 
all decisions that are made and, in addition, treats cells C and D (erroneous rejections 
and erroneous acceptances) as equally costly. 

In many selection situations, however, erroneous acceptances are 
viewed as far more serious than erroneous rejections. The employment manager 1s gen- 
erally more concerned about the success or failure of those persons who are accepted 
than about rejected applicants. Therefore, a more appropriate index of decision-making 


accuracy that are correct decisions: 


A 
Cae AD “a 
Where PC,,, 1s the proportion of those accepted who later turn out to be satisfactory, and 
A and D represent the total number accepted who are satisfactory and unsatisfactory, 
respectively. When the goal of selection is to maximize the proportion of individuals se- 


lected who will be successful, equation (4-2) applies. [Ref. 10: p. 249 250] 
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lil. DESCRIPTION OF THE CURRENT SYSTEM 
A. THE CURRENT SELECTION SYSTEM 


The Manpower Department foresees the future need of personnel for billets open- 
ing in each unit based on expansion of structure, transfer, retirement, and promotion. 
Thoughout assignment for NPS students bythe Department of defense, the Education 


Department recruits and selects the number of NPS candidates. 


1. Qualification 
The basic qualifications required to attend NPS are set forth as followed: must 
hold a rank of at least O-2 or O-3; Service record must be unblemished with no past re- 
cord of non-judicial punishments; can not have been a significant time under hospital 
care; must have at least 3.0 in academic grade point average during undergraduate 
studies ; a comprehensive biographical background check must be conducted; and must 


not have past history of any unauthorized absence from appointed place and time. 


2. Application Screening 
The Korean Education Department screens the application reviewing the indi- 
vidual qualification and records. As a result, the candidates with insufficient qualifica- 


tions and poor records are seperated 


3. Testing 

Testing consists of ECL (English Comprehension Level) test, Korean history, 
TOEFL (Test of English as Foreign Language), and major qualification test. The first 
three tests are common for all the NPS candidates. The major qualification test is dif- 
ferent for each curriculum. The minimum required score for ECL test is 70. If a candi- 
date does not receive the minimum score, he fails to get into the program whether he 
passes any other test. The remaining three tests are weighed equally. Currently, the Ed- 
ucation Department requires candidates take a ECL, TOEFL, Korean history and major 


qualification test stimulaneously. 
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4. Selecting Committee 

The test scores, past education record, past performance records, and committee 
interviews are all given a certain amount of weight to be considered into the program. 
Test score is 60 percent, past education record (including officer basic and service 
school) is 10 percent, Past performance is 20 percent, and committee interview is 10 
percent. The interviewer's main focus toward the candidate is that he has spent his time 
in a career-enhancing duty. Also, it is a requirement that the candidate have a high de- 
gree of technical knowledge and a master degree. 

The selecting committee tries to place the candidate according to his back- 
ground. For instance, if the candidate is a communication officer, he would be ideal for 
the electric engineering curricula. 

After all, the selecting committee selects two candidates. One will be the pri- 
mary candidate and the other will be the alternate cadidate. The primary candidate is 
required to take the ECL test at the Education Department of the U.S. 8th Army Corps 
in Seoul, Korea. The primary candidate must score a minimum of 85 on the ECL test. 
He is given two chances to pass the test. If unable to pass the test on his second try or 
if he failed the physical examination, the alternate candidate is given the ECL test and 
the physical examination. 

The Education Department forwards the results of two of candidates to NPS 
and the candidates should receive admision from NPS. If the selectees do not receive 
admission from NPS and attain the minimum scores of the ECL test, they are skipped 


at the final selection. 


5. Training at the Military Language School. 
After the decision of the first selection, all the selectees should receive the English 
training course for six weeks. But, if the selectees are unable to take the English lan- 
guage course due to the completion of their careers, they are exempted from the English 
training course. In this case, they are responsible for increasing their English ability and 


preparing for the formal ECL test on their own. 


B. PROBLEMS 


Presently, manpower planning has some problems in determining the selection stu- 


dents for NPS. These are the inadequate forecast of present and future total needs of 
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overseas education. Also, the selection process has some problems in determining who 
attends and what curricula they will study. The majority of students are all in limited 
curricula and occupational codes. This often excludes some occupational codes. Other 
vital curricula are under-represented. This policy limits the exposure of a wide variety 
of officers to various important curricula that could play a key role in the effectiveness 


of the Korean Navy. 


The following are some specific problems: 


I. [Inadequate assignment for NPS students (Navy) by DoD 
The Korean Department of Defense (DoD) has not sufficiently balanced out 
the ratio of its military manpower assigned to the NPS Based on five years from 1983 
to 1987. The Navy is far lower than the Army or Air Force. As Table ] indicates, Army 
students during the five years totaled ninety, Air Force totaled for forty-three and Navy 
totaled thirty-six. 


Table 1. KOREAN STUDENTS WHO GRADUATED IN NPS 





2. Inadequate Assignment for Each Curriculum 
Most of the officers in NPS are assigned to the technical curricula such as 
Weapon Science and Electric Engineering. Other important curricula such as Adminis- 
trative Science, Computer Science, and Information Science are poorly represented. As 


a result, most officers become expert in the technical fields, but are not well prepared in 


Zz 


management and organization. The Korean Navy will benefit technically, but its man- 


agement and organizational skills will not keep pace. (See Table 2.) 


Table 2, CURRICULUM OF KOREAN NAVY IN ATTENDING NPS BY 
YEARS 
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3. Inefficient Assignment for Each Branch of Service 

The specific branches of the Korean Navy are not well represented in NPS. 
Despite the fact that the line officers make up two-thirds of the total number of officers 
in the Navy, currently there are few line officers attending the school. Other specialty 
fields such as supply, financial, are not represented at all. Also, other fields such as in- 
telligence, aviation are little represented. Only those highly technical fields such as 
Communications, Engineering, and Weapon Systems are well represented. (See Table 
33) 

This inefficient assignment for each branch of service may cause undesired mo- 
rale consequences for those officers who really have the desire and greater potential of 
becoming competent officers, and those who at least think they might have deserved the 


opportunity but that their career pattern did not provide them the chance. 
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Table 3. OCCUPATIONAL CODE OF KOREAN NAVY OFFICERS IN 
ATTENDING NPS 
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Table 4. CROSS-TABULATION BY CURRICULA 
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Curricula such as Administrative Science would be beneficial to those fields not 
currently represented. Also, each branch of the Navy has been sending their officers to 


only one or two of the specific curricula. For example, the line officers have only few a 
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option, Administrative Science , Operations Research, and Engineering Acoustics. They 
are not allowed to study any other curricula although they are fullv qualified to do so. 
(See Table 4.) 


4. Inadequate and Insufficient English Education 
The Naval officers, who are assigned to NPS for two years, are usually inade- 

quately prepared in their English language skills. Prior to taking the formal ECL test, 
all candidates are required to receive a six-week English training course. The six-week 
English training they receive prior to coming to NPS is inadquate. Also, many senior 
line officers do not let the young line officer candidates take this important course. Their 
reasoning 1s that the young officers are needed to perform military duties. As a result, 
the failure-rate for the line officers in the ECL test is a lot higher than the other officers 
of other services. Also, the ECL test and TOEFL test given to each student do not re- 
inforce the student's ability to understand the requirements set forth by the NPS. The 
ECL test only tests the listening and reading portion of the English language. The 
TOEFL test tests the grammer portion of the English language. But neither test ad- 
dresses the composition and talking portion of language. 
5. The Shortage of Line Officer Recognition for Education 

There is distinct evidence that coming to the NPS is disadvantageous for many 
Korean line officers. Many senior officers do not see U.S education as benifical to the 
service. They would rather have the voung officers spend more time on the ships in op- 
erational duties. Many of the senior officers have never received postgraduate educa- 
tion, and they feel resentful toward the young officers who do receive education. Asa 
result, many qualified young line officers intentionally fail or do not take the exams 
which would bring them to the U.S. This results in a pool of highly intelligent officers 
spending their time on the ships instead of furthering their education. 


6. Inefficient Interview (Committee) 
Prior to coming to NPS, all officers must be interviewed. This inteview, along 


with exams, qualify the officers for the program. The members of the interview com- 


1 Curncula Code are following; AS: Administrative Science, CS: Computer Science, OR: 
Operations Research, JS: Information Science, WS: Weapon Science, EE: Electrical Engineering, 
OG: Oceanographic, ME: Mechanical Engineering, EA: Engineering Acoustics. 
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mittee hold a powerful positions, but many of them are not qualified in the subjects for 
which they are interviewing. For instance, an officer being interviewed for a MPTA 
(Manpower, Personnel Training and Analvsis) course probably will have a single inter- 


viewer with only little knowledge of the subject. 


7. Inefficient Past Performance Appraisal 

Actually, the requirements to come to the NPS do not take into account an of- 
ficer’s past performance. Sometimes, past performance appraisal depends on selection 
committe and senior officer’power instead of actual past performance. As a result, an 
officer with a poor past performance may be able to take the exam and qualify for the 
program. An officer with a poor performance record probably will not get promoted, 
but if he was to get into the program his future might look brighter. This is due to the 
fact that after two vears in the NPS, the officer will owe four vears of obligation. That 


is six years of service which he probably would not have gotten. 
To increase efficiency from the overseas education, the problems of the current 


system must be identified from the analvsis of the current system and eliminated through 


redesigning the selection. 
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IV. ANALYSIS 


A. ANALYSIS 


1. Data 

The data used in this thesis are from the “Record of Korean Navy students who 
graduated from the NPS between 1983 and 1987”. These data include NPS grade, Naval 
Academy grade, ECL testing score, TOEFL testing score, each curriculum of NPS, and 
branch of service. SPSSX will be used to conduct the analysis (See the Appendix A). 

Grade average at NPS is a good criterion for evaluating the selection process. 
Also, English is a very important factor in learning at NPS for foreign students. This 
analysis attempts to determine a model for the prediction of this criterion from the 
English Comprehension Language test (ECL test), Naval Academy grade (NA grade), 
and a Test of English as Foreign Language (TOEFL test). 


2. Regression Analysis 
The relationship between correlation and regression is the foundation for the 
relationship between multiple correlation and multiple regression. Multiple regression 
permits prediction on the basis of multiple predictors. Suppose we have criterion data 
on NPS grade (average) and predictor data on the NA grade (average), ECL testing 
score, and TOEFL testing score that we think may be useful for selecting future stu- 


dents. The regression equation 1s the following: 


Y = =o Oli eral nO one 


where 

Y = Performance in NPS (NPS grade), 
X, = NA grade, 

X, = EG Westingescone: 

X, = TOEFL Testing Score. 


The degree of predictability afforded by the three predictors is measured by the 


multiple correlation between the predictors and the criterion. If the multiple correlation 
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is large enough to be of some value for prediction purposes, we might use the three 


predictors to select NPS students. 


As indicated Table 5, the multiple R square is 0.695. Also, the NA grade and 
ECL testing score are significant at the 0.01 level. The TOEFL testing score is signif- 
icant as predicted at the 0.1 level. Therefore, the NPS grade has a linear relationship 


with NA grade, ECL testing score, and, to a smaller extent, TOEFL testing score. 


Table 5. REGRESSION RESULTS 
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3. Correlation Coefficient 

The correlation coefficient is a statistical indicator of the linear relationship 
between predictor and criterion scores. In a validation study, it is also called the validity 
coefficient. 

This statistic summarizes the degree of linear association. The values of a 
correation coefficient range between + 1.00 and -1.00. A correlation of + 1.00 represents 
a perfect positive relationship and indicates that if you know the value of one variable, 
the exact value of the other variable can be determined. A correlation of zero indicates 
that no linear relationship exists, and a correlation of -1.00 represents a perfect negative 
correlation between two variables. 

The criterion is the NPS grade and the predictors are Naval academy grades, 
the ECL testing scores and TOEFL testing scores. 

The Naval Academy grade has a strong relationship with the NPS grade 
(r=0.706), and the ECL testing score also has a strong relationship with NPS grade 
(r=0.732). Also, the TOEFL testing score has a strong relationship with NPS grade 
{r=0.679). (See Table 6.) 


Table 6. CORRELATION COEFFICIENT BETWEEN CRITERION AND PRE- 
DICTORS. 





4. Expectancy Charts 
Expectancy charts are an alternative to the correlation coefficient as a means 
of showing a test’s validity. An expectancy chart shows what percentage of Koeran 
Naval students in each testing score category will meet a certain level of job perform- 


ance. Expectancy charts provide a method for interpreting testing scores in terms of the 
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probability of successful performance. Each bar on an expectancy chart shows what 
percentage of the Korean Naval students in a given predictor category are successful. 
Valid predictors typically produce expectancy charts with long bars for high predictor 
scores and short bars for low predictor scores as illustrated in Figures 5, 6, and 7. The 
data from which the expectancy charts in Figures 5, 6, and 7 were derived are shown in 
Tables 7, 8, and 9. 

Although expectancy charts show the same information that is reported by a 
validity coefficient, expectancy charts are more useful in counseling candidates since 
most candidates do not understand correlation coefficients. Expectancy charts have one 
major advantage over the correlation coefficient as a means of expressing test validity: 


Thev are not limited to linear predictor-criterion relationships. 


Assume that those officers who attained above 3.3 in NPS grade are considered 
successful in academic performance rated by the Education Department. 

Figure 5 displays the relationship between ECL tesing score and the percentage 
of students graduating from NPS with a grade above 3.3. Those who are above an ECL 
test scoring between 89-90 have 100 percent probability of getting above an NPS grade 
of 3.3. Twenty five percent of students scoring between 85-88 have a probability of 
getting above an NPS grade of 3.3. Seven percent of students scoring between 82-84 
have a probability of getting above an NPS grade of 3.3. Also, zero percent of students 
scoring between 80-81 have a probability of getting above an NPS grade of 3.3. 

As Table 6 indicates, the probability of getting above an NPS grade of 3.3 1s 50 


percent for those who are above ECL testing score of 85. 


Figure 6 displays the relationship between NA grade and the percentage of stu- 
dents graduating from NPS with a grade above 3.3. Those who are above an NA grade 
ranging between 3.45-3.85 have 100 percent probability of getting above an NPS grade 
of 3.3. Sixty seven percent of students scoring between 3.30-3.44 have a probability of 
getting above an NPS grade of 3.3. Nine percent of students scoring between 3.15-3.29 
have a probability of getting above an NPS grade of 3.3. Also, six percent of students 
scoring between 2.75-3.14 have a probability of getting above an NPS grade of 3.3. 

As Table 8 indicates, the probability of getting above an NPS grade of 3.3 is 85 


percent for those who are above NA grade of 3.3. 
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Range of ECL 
Testing score 


89-92 
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Percent of Korean Navy students rated 
"Successful" 





Figure 5. Expectancy Chart of ECL Testing score 


Table 7. EXPECTANCY TABLE OF ECL TESTING SCORE 


ECL Testing No of No of fail Percent who were 


scores successful successful 


89-92 6 100% 


85-88 Z 
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Figure 6. Expectancy Chart of NAG 
Table 8. EXPECTANCY TABLE OF NAG 
NA grades | No of No of fail Percent who were 


successful successful 


3.45-3.85 5 


3.30-3.44 2 


3.15-3.29 
2.75-3.14 
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Figure 7. Expectancy Chart of TOEFL Testing Score 


Table 9.5 EXPECTANCY TABLE OF TOEFL TESTING SCORE 


MOE F lv No of No of fail Percent who were 
testing scores successful successful 


85-90 5 100% 


80-84 12.5% 


Z 
75-79 2 
Q 


70-74 
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Figure 7 displays the relationship between TOEFL tesing score and the per- 
centage of students graduating from NPS with a grade above 3.3. Those who are above 
a TOEFL test scoring between 85-90 have 100 percent probability of getting above an 
NPS grade of 3.3. Twelve and one-half percent of students scoring between 80-84 have 
a probability of getting above an NPS grade of 3.3. Forty percent of students scoring 
between 75-79 have a probability of getting above an NPS grade of 3.3. Also, zero 
percent of students scoring between 70-74 have a probability of getting above an NPS 
grade of 3.3. 

As Table 9 indicates, the probability of getting above an NPS grade of 3.3 is 35 


percent for those who are above a TOEFL testing score of 80. 


5. The Outcomes of Predictions. 

The multiple regression equation gives rise to a continuous distribution of 
predicted outcomes, y, which are “cut” at some point as a practical method of making 
personnel decisions. The distribution of actual criterion performance (when available) is 
similarly cut at some point to enable a distinction between “successful and unsuccessful” 
performance. The joint frequency distribution with probabilities of predicted and actual 
criterion scores is presented in Figure 8. 

Four possible outcomes of prediction may be delineated. When success is pre- 
dicted and success results, we refer to the individuals so classified as valid positives (VP). 
When success is predicted and failure results, we speak of false positives (FP). When 
failure is predicted and failure occurs, we have a group of valid negatives (VN). And 
finally, when failure is predicted but success occurs, we are dealing with false negatives 
(FN). 

The total number of predicted positives, P’, may be calculated from: VP + FP. 
Similarly, the total number of predicted negatives, N’, is given by: FN + VN. Also, the 
number of “actual positives”, P, that exist in the total sample may be calculated from: 
P = FN + VP. Similarly, we may calculate the number of “actual negatives,” N, that 
exist in the total sample from: N = VN + FP. 

To facilitate comparison of prediction outcomes in samples of varying size, it 
is preferable to express frequencies as simple probabilities or proportions of the total 
size. One does so by dividing the frequency of a given outcome by the total number of 


people in the sample. Thus the probability of occurrence of a valid positive is given by: 
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P(VP) = VP/(P + N). This probabilistic representation of the outcomes of test predic- 
tion is given in Figure 8. [Ref. ll: p. 242-243] 

The row and column totals of Figure 8 are also expressed as probabilities. Be- 
cause these marginal totals are of critical importance in the evaluation of test pred- 
ictions, they have been given special names. The probability or proportion of actual 
positives that exist in the total sample of applicants is called the base rate (BR). This 
probabilitv may be calculated directly [BR = P/(P + N)] or from the probabilities of 
two outcomes [BR = P(FN) + P(VP)]. The expression “base rate” usually has reference 
to the base rate of the positive class. The probability or base rate of failure in the total 


sample is given by the expression: 1 - BR. 


| 
Probability of | Probability of Probability of 
false negatives | valid positives actual positives 


PFN) = FNP +N) | P(VP)=VP(P+N)| BR= PAP +N) 


Criterion 
standard 


Probability of Probability of Probability of 
valid negatives false positives actual negatives 


PVN) = VN(P +N) | P(FP)= FPP +N) | (1-3) = N/(P +N) 
: | : ° 


Probability of Probability of 
predicted negatives predicted positives 


(1—SR)=NAP+N)| SR= PP +N) 


Cutoff on 
predictor 





Figure 8. Outcomes of Test Predictions 


The probability or proportion of predicted positives among the total sample of 
applicants is called the selection ratio (SR). This probability may be calculated directly 
[SR = P’/(P’ + N’)] or from the probabilities of two outcomes [SR = P(VP) + P(FP)]. 
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The importance of these two marginal probabilities, base rate and selection ratio, cannot 
be overemphasized. Also, the probability of accuracy of prediction may be calculated 
from P(VP) + P(VN);(P + N). (Ref. I]: p. 244] 

Assume that the dashed horizontal line in the diagram represents a dividing 
line.; Those individuals rated at or above this line (NPS grade 3.3) were considered 
successful in the NPS as predicted by the Korean Navy Education Department; those 
rated below the line Were considered not successful. The vertical line represents the cut- 
ting point on NA grade, ECL testing score and TOEFL testing score when individuals 
scoring above this point would be selected (in the future) and those scoring below the 
point would be rejected. These two lines allow the division of the diagram into four 


quadrants. (See Figures 9, 10, and I1.) 
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Figure 9. Outcome of ECL Testing Score 


As Figure 9 indicates, with r= 0.732, the accuracy of predictions is 0.75 and the 


base rate is 0.25. 


That is, 75 percent of the predictions made using the test were correct. This 
seems to be fairly impressive evidence in favor of the test. This is the proportion of ap- 
plicants who would succeed on the NPS if the ECL test was not used to select them. The 
accuracy of the predictions made using the test was .75 compared to a base rate of .25. 
Thus, the use of the selection system represents a gain in the accuracy of predictions 
made compared with using no selection test. 

The selection ratio is the proportion of individuals actually selected to those 
who applied. This would represent a selection ratio of 0.44 percent in Figure 9. 
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Figure 10. Outcome of NA Grade 


As Figure 10 indicates, with r=0.706, the accuracy of predictions of NA grade 
for NPS grade is 0.83 and the base rate is 0.25. Also, the selection ratio is 0.23, and the 


success rate 1s 0.87. 
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As Figure 11 indicates, with r=0.679, the accuracy of predictions of TOEFL 
testing score for NPS grade is 0.50 and the base rate is 0.25. Also, the selection ratio 1s 


0.64, and the success rate is 0.56. 


@ 7 
Geetaysraly) (P=0.2) BR= 9.25 
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1-3R= 0.75 
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Figure 11. Outcome of TOEFL Testing Score 


Throughout the analysis of these predicted outcomes, the effective cutting score 
to increase the NPS performance should be a score of 85 or more on the ECL test, above 
3.3 on the NA grade, and a score of 80 or more on the TOEFL test. 


6. Taylor-Russell Tables 
It is possible to compute the improvement in the quality of the work force bv 
using a certain predictor if we know (1) its validity, (2) the selection ratio, and (3) the 
percentage of present emplovees who are successful. It 1s also possible to compute the 
additional improvement in work force quality if test of greater validity is used or if the 


selection ratio is lowered. This information is a given in the Tavlor-Russell tables (Tavlor 
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& Russell, 1939). The Taylor-Russell tables list the percentage of employees hired who 
will be satisfactory under different combinations of test validity, selection ratio, and 
percentage of present employees considered successful. [Ref. 5: p. 231] 

Throughout the Tavlor-Russell Table, the accuracy of prediction for the NA 
grade, ECL testing score, and TOEFL testing score would be calculated. 


The value of a prediction system varies as function of three basic variables: 


1. The magnitude of the validity coefficient - As validity increases, so does the value 
of the system. 


to 


The base rate - As the base rate approaches 50 percent, the selection system dem- 
onstrates greater value. 


3. The selection ratio - As the selection ratios become smaller, the value of a selection 
increases, (Rel. 12..p23 7 | 


B. SELECTION STRATEGIES FOR NPS CANDIDATES 


1. The Multiple Regression and Multiple Cutoff Methods. 

Theses methods can be used in combination. This can take the form of not 
hiring some people unless their predicted criterion score was above a certain level (from 
the multiple regression stratege) and they were above some cutoff on each predictor 
(from the multiple cutoff strategy). These techniques work best when the selection ratio 
is low and there are many applicants. Large numbers of applicants are needed because 
many will be rejected for one of two reason: (1) They fell below the cutoff on one or 
more predictors, or (2) even though thev were above each individual cutoff, their pre- 
dicted criterion performance was not high enough. This combined approach is often used 
in selecting students for graduate school. Applicants usually must have minimally ac- 
ceptable quantitative and verbal ability as well as an acceptable predicted grade-point 
average in graduate school (a frequently used criterion of success in academia), [Ref. 5: 
P2555) 

For the multiple cutoff method, the effective cutting score to improve the NPS 
performance should be a score of 85 or more on the ECL test, above 3.3 on the NA 
grade, and a score of 80 or more on the TOEFL test. 

The NA grade, ECL testing score, and TOEFL testing score are important for 
predicting the NPS performance: 
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iS OLLK, + .319-X, + 025%, 


where Y= Performance in NPS CNPS grade), X, = NA grade, X,= ECL Testing Score, 
X, = TOEFL Testing Score. 


If candidates receive high enough values of Ys they will be selected. 


If the candidates fall within a score of 85 or more on the ECL test, above 3.3 
on the NA grade, and a score of 80 or more on the TOEFL test, and if (as a first se- 
lection step) 


Y =—.8 + .275(3.3) + .319(85) + .025(80) = 29.2, 


they are the most desirable selectees and offer the highest potential to achieve high NPS 
performance. 

If the number of candidates chosen by this method are under the required 
number, a different multiple cutoff strategy or multiple regression equation should be 
applied to select the NPS candidates. 


C. FACTORS CONSIDERED IN SELECTING NPS CANDIDATES 


1. Making the Selection Organization-wide 
This is a necessary factor because it gives an equal opportunity to every eligible 
and willing officer to apply for NPS education and it also increases the organization's 
possibility of making a better choice among the available officers. This factor can also 
decrease or even eliminate the resentments of those groups of officers who under the 
present system may believe they are deprived from a good career pattern --not being in 
the right place at the right time. 


2. Education Background 
The educational background of the candidates does not necessarily need to be 
an outstanding one. But, 1t must show at least a steadily successful scholar, able to suc- 
ceed in advanced educational program of NPS. For example, strength in Mathematics 


and English will certainly increase the individual’s chances of acquiring the analytical 


oo 


ability and in learning the quantitative methods of problem solving which necessary for 


today’s officer in technical profession. 


3. Rank 
It was seen before that current policy of selecting the officers among the ranks 


of Lieutenant and Lieutenant Junior Grade is most benefical to the organization. 


4. Past Performance 
As emphasized in any organization and especially in the military in differen- 
tiating individuals for a privilege, the record of past performance takes an important 
role. Of course the current selection procedure takes into account the past performance, 
but onlv as a determining standard and not as a differentiating factor among otherwise 
equally suitable candidates. This is because of the general structure of the present se- 
lection system that does not allow for centralizating and harmonizing the measurement 


of factors and for against one another. 


5. The Selection Committee 

The members of the selection committee is required mature and experienced 
officers having experience in a variety of jobs and they should preferably represent dif- 
ferent function of the organization at the time of selection. Among the members there 
ought to be officers with a good deal of experience. The members of the committee are 
helped by an officers’ detailer and representative from the Education Department expert 
in NPS education. The task of the selection board is so crucial for good results that there 
is no need for overemphasizing the necessity of selecting really capable officers as its 


members. 


6. Equal Selection Opportunity 
Those officers who really have the desire and a greater potential for becoming 
component officers areoccasionally overlooked by the Education Department because 
of poor communication systems. Therefore, Communication with qualified officers is 
necessary as it increases opportunity to eligible and willing officers to apply for NPS 
education and also increase the organization’s possibility of making a better choice of 


available officers. 
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The current system of placing certain branches of the Navy with specific cur- 
riculum must be overhauled. The officers should be placed in the curriculum of their 
choice and abilities. Also, more line officers must realize that furthering the education 
of their young officers is just as important as spending their time on the things a well- 
rounded and educated officer corps will provide more for the nation 


7. The “Whole Person Concept” 

The “whole person ” concept should be considered when matching people and 
jobs. When the personnel department selects candidate, the whole person 1s selected with 
all of the strengths and weaknesses, judgments and foibles, personal problems and fail- 
ures, and the motivation to work, as well as the nonproductive tendencies which are 
found in all people. Empirical evidence shows that it is impossible to separate the posi- 
tive factors that lead to productivity in an individual from the negative elements that 
result in a lack of productivity. However, candidates , when properly motivated, may 
compensate for their weaknesses by concentrating on, and developing, their strengths, 


in Which case they should become more effective candidates. 


8. Good Career Development 
For NPS graduate the Korean Navy should provide good career development 
such as promotion and good jobs. If the returning graduates are rewarded with accel- 
erated promotion and improved performance marks more officers will try to get into the 
program. As a result, the overall standards of the NPS graduates will improve and more 
highly-educated personnel will emerge. Also, excellent candidates will apply to NPS. 
The Korean Navy will definitely benefit from this and the furture will be bright. 


4] 


VY. NEW MODEL 


A. ASSUMPTION 


1. Equal Selection Opportunity 
For all branches of service the Navy education department gives equal selection 
opportunity. That is, with limited space (students), the Navy education department dis- 


tributes for each curriculum and each service equally. 


2. Change in English Education. 

The period of language training is too short. It is very difficult for Korean of- 
ficers to have spare time to increase their English language ability during regular duty 
time. Also, the form of ELC testing is centered upon listening ability. But speaking, 
comprehension , and writing ability as well as listening ability are also important to the 
Korean students. So, The English training school should change its education system 


(including the education time period). 


3. Good Career Development for NPS Graduates 
Presently, the NPS graduate does not have a good career development in the 
Korean Navy. Therefore, many excellent officers do not apply to NPS a key step in their 
future. For good career development, NPS graduates must show good performance in 
NPS 


B. NEW MODEL 


In order to meet the NPS selection objective, several factors have been combined to 
form the primary determiners of the effectiveness of the NPS selection process in our 
Navy. (See Fig 12.) 


1. Manpower Resources Planning 
Prior to seeking information about individuals, the organization must determine 


the numbers and kinds of people required and where they are to be placed. Because or- 
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en. 7 
ganizations must adapt to changing conditions (such as growth, new technology, and 


market variations), human resources planning is a continuing operation. 
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Figure 12. New Selection Model of Korean Navy Selection Process for NPS 
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As Schneider (1) observes, three kinds of analyses are required, namely organazational, 
staff, and job. 

Organizational analysis provides information on the environment in which the 
organization exists. As the environment changes, so must the organization. Changes in 
Organizational structure, in jobs, and even in organizational goals may be a conse- 
quence. In turn, the kinds of people necessary to accomplishing organizational objec- 
tives can be affected. The impact of automation on many organizations is an example. 

Jobs are organizational entities. They must be designed to facilitate accom- 
plishing organizational goals. The responsibilities and duties of each job, which are re- 
flected in the tasks performed, determine the knowledge, skills, and abilities people must 
bring to a job in order to accomplish its objectives. Thus analvses of jobs are essential 
to determine an organization’s personnel requirements. 

Finally, staff analysis is essential. An organization must have current informa- 
tion on its own people. A comprehensive personnel record system accompanied by ana- 
lyses of the data available from the svstem can yield information pertinent to many 
selection decisions, especially those involving promotions, transfers, demotions, and 
terminations, Furthermore, deficiencies in the human resources of an organization can 
be identified, as well as how to correct such deficiencies through training programs, 
recruitment from outside the organization, and other possibel means. [Ref. 12: p. 20] 

The Department of Defense and the Navy Manpower Department do not 
interact or coordinate with each other. As a result, the curricula requested by the Navy 
are assigned to different branches of the Army and Air Force. Also, those curricula not 
requested by the Navy are assigned to the Navy manpower Department by the DoD. 
The Navy Manpower Department must find out what curricula are requested by the 
branch of the Navy and then coordinate with the DoD to gain those curricula. Cur- 
rently, the Korean Navy continues to send its officers to the technically oriented curric- 
ula according to specific designation and general curricula such as Administrative 
Science are over-looked. The technical curricula have received attention over many 
years, and other curricula have continued to be neglected. In order to bring all the cur- 
ricula into an equal level, a system must be initiated where each year different curricula 
should curricula should be stressed. For instance, one year the curricula are stressed, 


then in the next year other curricula are stressed. 


2. Recruitment 

Recruitment following the traditional model focuses on locating people who 
have the abilities to perform the jobs for which they applied. That such jobs may not 
meet the needs of people hired for them is given little if any consideration. Once em- 
ployed, such people may become dissatified and leave the organization, frequently after 
very short service. This is costly to the organization, especially if extensive training 1s 
involved. 

In contrast, realistic recruiting seeks to give the propective employee informa- 
tion concerning both the favorable and unfavorable aspects of the position for which an 
offer of employment is to be made. The prospective employee then has the option of 
deciding whether or not the position is acceptable. Studies of realistic recruiting have 
prodeced results benificial to a number of organizations applving the approach. [Ref. 
1p. 21) 

Recrutment is the term applied to that phase of personnel management which 
is concerned with reaching out and attracting a supply of people from which to select 
qualified candidates for job vacancies. An effort is thus made to attract potential em- 
ployees with the necessary characteristics and in the proper quantities for the jobs 
available. An effective and systematic method of recruitment will minimize the cost of 
selection and training result in an efficient work force; an in effective method will result 
in wasted manpower. [Ref. 9 p. 244] 

The primary goal of recruitment is to provide a sufficiently large pool of candi- 
dates form which to select qualified NPS students. If applicants do not provide the 
necessarv information documenting their minimum qualification, they are not given any 


further consideration - thev are not permittted to take the formal examination. 


a. Application Form 
The Education Department should be cautious when eliminating individuals 
based on minimum qualifications derived from the application form. Any minimum 


qualifications must be job-related and based on sound job analysis. 


b. Qualification 
Currently, the minimum requirement for the entrants coming into NPS is a 
3.0 academy gradepoint average . These requirements are not sufficient. The standards 


must be raised to 3.3 academy grade point average to raise the overall academic 
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achievements at the NPS and checked current the basic qualifications required to attend 
NES. 


3. First Selection 

In the first selection, the Education should be on the basis of the standing of 
candidates in the list of the ECL tesing score and TOEFL Testing score. The purpose 
of English testing taking in advance ts to classified poor NPS cadidates for English lan- 
guage. Eventhough some candidates get good scores for other tests, if they do not have 
good English performance they fail to get good NPS grade through analvsis. Therefore, 
English is important factor in selecting the NPS candidate. 

For effective first selection, the multiple cutoff and regression method is re- 
quired. To the multiple cutoff method, the effective cutting score to increase the NPS 
performance should be a score of 85 or more on the ECL test, above 3.3 NA grade and 
a score of 80 or more on tne NOE Mieatesr 

The NA grade, ECL testing score, and TOEFL testing score are important for 
predicting the NPS performance. Therefore, the regression equation between them and 


NPS grade is as follows : 


Y SS -h ONLY, pea lnaerno mane 


where Y = Performance in NPS (NPS grade), 4, = NA grade, X, = ECL Testing Score, 
XxX, = TOEFL Testing Score 


If candidates receive high enough values of Y as well as the other three variables, they 
will be selected. 
If the candidates fall within a score of 85 or more on the ECL test, above 3.3 


NA grade, and a score of 80 or more on the TOEFL test, and if (as a first selection step) 
Y¥ =—.8 + .275(3.3) + .319(85) + .025(80) = 29.2, 


they are the most desirable selectees and offer the highest potential to show high NPS 
performance. 
If the number of candidates chosen by this method are under the required 


number, a different multiple cutoff strategy or multiple regression equation should be 


46 


applied to select the NPS candidates. Candidates who come up in the inappropriate 


categories of testing scores will be rejected. 


4. Second Selection 
In the second selection, if a candidate passes the first selection, the Education 
Department should select on the basis of the results on the Major Qualification Test and 
the Korean History Test. Actually, Korean History Tests are not good predictors for 
evaluating NPS performance. Therefore, the Education Department gives more weight 


to the Major Qualification score than the Korean History Score in the second selection. 


5. Third Selection 


a. Selection Committee 


(1) Past Performance Appraisal. The current selection procedure takes 
into account the past performance only as a determinative standard. But, in considering 
officers for a specific privilege, the record of past performance can be used as an 1m- 
portant differentiating factor for comparing candidates against one another. For exam- 
ple, the candidates should not have instances of judicial punishment during their military 


Service. 


(2) Education Record. As key officers for higher academic opportunities 
the following can be taken into account: OBC (Officer’s Basic Course in Korea) score, 
OAC (Officer’s Advanced Course in Korea) score, and the academic performance at the 


other military schools. 


(3) Interview. The purpose of the selection interview is to complement 
other selection and placement techniques and to assess qualities not objectively meas- 
ured by other means, in order to determine the suitability of an applicant for a specific 
opening in an organization. The interview should also give sufficient information to the 
applicant about the job and the company so he may have a basis for accepting or re- 
jecting employment if it is offered. A final purpose is to create a positive feeling toward 


the company and its management regardless of the outcome of the interview. Selection 
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interviews may help to assess personality and motivational traits, and if they correlate 
with criteria, can improve the selection batting average. 

The difficulty of estimating personality and temperament in the 
interview should not be minimized. Interviewers should regard their own attempts at 
appraisal of personality and temperament traits through interviews with considerable 
reservation and caution. [Ref. 6: p. 4-148] 

Through interview, background and performance ability should be 
emphasized so that the Education Department may do its best in identfying the personal 


characteristics of candidates . 


The interviewer should check to the following areas: 


1. Work history. (Duties, likes, achievements, dislikes, things done less well, working 
conditions, reasons for changing jobs, factors of job satisfaction, type of job de- 
sired, total job accomplishment.) 


te 


Education and training. (Best and poorest subjects, grades, how much effort, 
extracurricula activities, special achievement, training beyond the undergraduate 
level, total school achievement. ) 


2 


Personality, motivation and character. (maturity, emotional stability, teamworker, 

tact, adaptability, tough-mindedness, self-descipline, initiative, follow-through, 
self-confidence, aggressiveness, conscientiousness, hard worker, honesty and sin- 
Cerity.) 

It could be a beneficial effort to the organization not only for the 
purpose of improving the selection for NPS education, but also the purpose of increasing 
the benefits to the organization after the formal education. 

Also, the interview should be as directly related to actual job per- 


formance as possible. More ever, interview conducted by a board of interviewers apper 


to have higher reliability and validity than interviews conducted by a single interviewer. 


The following entrance requirements are recommanded: Major qual- 
ification testing should be 40 percent, Past performance record should be 20 percent, 
Personal interview record should be 20 percent, and Past education record should be 20 
percent. 

As outputs, the selecting committee selects two candidates. One will 


be the primary candidate and the other will be the alternate cadidate. 
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6. Physical Examination 
The phsycal examination should be designed to disclose all of the physial char- 
acteristics of the individual that are significant from the standpoint of the his efficient 
performance in the NPS. If candidate has serious problem, he should be skipped. Heart 
trouble, asthma or epilepsy are examples of recent health problems at NPS. These might 


have been better treated at home. 


7. English Language Training 
The individuals selected for the program are supposed to attend the military 
languge training. But due to the operational requirements, many of the candidates do 
not get this opportunity. Education Department must make it a requirement for the 
candidates to attend the language training. A directive must be formulated where no- 


body can force any candidate from not getting this vital educational opportunity. 


8. Final Selection 
After the completion of the language training, all the selectees should take the 
formal ECL test given by the Education Department of the U.S 8th Corps in Korea. 

With respect to final selection, the Education Department should resort to the 
additional achievement data (1,e., the formal ECL scores, and the acceptance by NPS). 
First, if the candidates are not accepted by NPS, they will not be considered candidates, 
If the candidates do not attain the required scores in the ECL test, they will also be 
skipped. 

The Education Department forwards the names of two candidates to NPS with 
the confidence that the candidates will receive admission to NPS. If the primary candi- 
date is unable to pass the formal ECL test or failed the phvsical examination, the alter- 
nate candidate is given the ECL test and the physical examination. If the selectees do 
not receive admission from NPS though they attain the minimum scores on the ECL 


test, they are skipped at the final selection. 
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VI. RECOMMENDATIONS AND CONCLUSIONS 


Education at NPS 1s very important to the future of the Korean Navy. English and 
education background are important predictors in evaluating good NPS performance. 
To be efficient the NPS selection, process should take note of poor English and NA 
grade performance. These candidates should be skipped prior to taking major qualifica- 
tion tests and the Korean history test. The purpose of English testing taking in advance 
is to classify poor NPS cadidates for English language. Even though some candidates 
get good scores for other tests, if they do not have good English performance they fail 
to get good NPS grade through analysis. Therefore, English is important factor in se- 
lecting the NPS candidate. 

For effective first selection, the multiple cutoff and regression method is required. 
To the multiple cutoff method, the effective cutting score to increase the NPS perform- 
ance should be a score of 85 or more on the ECL test, above 3.3 NA grade and a score 
of 80 or more on the TOEFL test. If the candidates fall within a score of 85 or more 
on the ECL test, above 3.3 NA grade, and a score of 80 or more on the TOEFL test, 


and if (as a first selection step) 
¥ = —.8 + .275(3.3) + .319(85) + .025(80) = 29.2, 


they are the most desirable selectees and offer the highest potential to show high NPS 
performance. 

If the number of candidates chosen by this method are under the required number, 
a different multiple cutoff strategy or multiple regression equation should be applied to 
select the NPS candidates. Candidates in the inappropriate categories of testing scores 
will be skipped. 


To increase overall effectiveness in selecting NPS candidates, the following recommen- 
dations are proposed: 
> 
First of all, many Naval officers must be given an opportunity to further their edu- 
cation. The senior naval officers must also realize that education is vital to the Navy's 
future. Operational Commitments are important, but the senior officers should not be 


close-minded. Instead, they must be open-mined and flexible. They must help to find the 
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opportunity for the young officers to develope their minds and help the Navv. Instead 


of discouraging the young minds, the senior officers must encourage them. 


Second, the NPS graduatee who return to Korea and to their commands are fre- 
quently penalized by the senior officers. If the returning graduates are rewarded with 
accelerated promotion and improved performance marks, more officers will try to get 
into the program. As a result, the overall standards of the NPS graduates will improve 
and more highly-educated personnel will emerge. The Korean Navy will definitely benefit 
from this and the future will be bright. 


Third, the line officers are currently neglected in the selection process of attending 
NPS. This should not happen because the line officer community is the largest in the 
Navy and the rest of the branches exist to support the line officers. The line officers must 


get priority over the rest of the branches. 


Fourth, compared to the other branches of the military, the Navy candidates to the 
NPS do not receive sufficient English language training. The Navy requires a six-week 
language training while the Army requires 6 months and the Air Force requires 3 month. 
This must change and the Navy must expand its language-training period. This will re- 
sult in a better-prepared officers comong to the NPS. Also, Navy candidates to NPS 
sometimes could be incorporated with the Army personnel program until a Navy lan- 


guage training can be fully incorporated. 
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APPENDIX A. SPSSX PROGRAM 
FILE HANDLE TEST / NAME = 'TEST SPSSX Al’ 


DATA LIST 

/1 NPSG 1-4 
ECL 6-7 
NAG 9-12 
TOEFL 14-15 
BRANCH 17 
CURR 19 
YEAR 21 


VARIABLE LABLES 
NPSG 'NPS GRADE' 
ECL ‘ECL SCORE. 
NAG 'NAVAL ACADEMY GRADE' — 
TOEFL 'TEST OF ENGLISH AS A FOREIGN LANGUAGE' 
BRANCH 'BRANCH OF SERVICE' 
CURR 'CURRICULUM' 
VALUE LABELS 
BRANCH "ENGINEERING' 
"INTELLIGENCE ' 
' COMMUNICATION ' 
" SURFACE-WARFARE' 
"COMPUTER' 
"EDUCATION ' 
"WEAPON: 
"AVIATION / 
"ADMINISTRATIVE SCIENCE' 
"COMPUTER SCIENCE' 
"OPERATIONS RESEARCH' 
"INFORMATION SCIENCE' 
"WEAPON SCIENCE' 
"ELECTRICAL ENGINEERING' 
'OCEANOGRAPHIC' 
"MECHANICAL ENGINEERING' 
"ENGINEERING ACOUSTICS' / 
33! 
"ga! 
'g5' 
'g6' 
Boe 
RECODE NPSG( 2.75 THRU 3.14=1) (3.15 THRU 3. 29=2) 
(3.30 THRU 3.44=3) (3.45 THRU 3. 85=4) 
INTO GRADNPS 
RECODE NAG(2.75 THRU 3.14=1) (3.15 THRU 3.29=2) 
(3.30 THRU 3.44=3) (3.45 THRU 3. 85=4) 
INTO GRADNA 
RECODE ECL(80 THRU 81=1) (82 THRU 84=2) (85 THRU 88=3) (89 THRU 92=4) 
INTO SECL 
RECODE TOEFL(70 THRU 74=1) (75 THRU 79=2) (80 THRU 84=3) (85 THRU 90=4) 
INTO STOEFL 


CURR 


YEAR 


UW PWN OO OnNIDM PWN On~AIDN EWN 


BEGIN DATA 
30S 84 2.9557) 457 5-5 


a2 


peeoero2 5.03 62 6 6 S$ 
megomco 3.75 90 3 6 5 
Peo 3.52 86 3 6 5 
e208 64 3.13 80 75 5 
eeeseo2 3.11 78 1 3 5 
Peo 92 3.42 88 6 3 4 
ego 82 2.97 7/4414 
Bes 60 2.79 82764 
mee O/ 3.13 82524 
emo oo 3.23 78 5 3 4 
emroeoe 5.18 76 7 5 3 
emeaegs 35.03 82 3 6 3 
eaeoeo, 3.38 84 6 6 3 
aon 90 3.68 84 3 6 3 
Smono0 39.23 74 5 3 3 
Bevo ol 5.43 82 1 8 3 
pee? 64 3.23 84 1 8 3 
pmeoeo? 3.83 90 3 6 2 
omeeo> 3.28 80 7 5 2 
omeeeo) 3.08 72 7 5 2 
meeeo2 2.89 76 4 1 2 
Smeeoeo> 2.95 80 11 2 
Se erso 3.12 7/6 3 2 2 
ieeos 3.16 82 6 9 2 
3.13 84 3.04 84 14 2 
weeeo+ 3.17 78 4 9 1 
mee o2 3.15 82 11 1 
fo 6s 3.23 72161 
omzonwoco 35.08 80 3 6 1 
paoeo? 2.89 84 3 6 1 
omeeeos 3.05 80 8 7 1 
omoeoc 3.18 76 27 1 
feos 3.13 7263 1 
pee eeo/? 3.23 8243 1 
Smee s2 3.46 88 6 8 1 


END DATA 
CONDESCRIPTIVE ECL/NAG/NPSG/ TOEFL 
CROSSTABS TABLES=BRANCH BY CURR/CURR BY YEAR/BRANCH BY YEAR/ 
GRADNA BY GRADNPS/SECL BY GRADNPS/STOEFL BY GRADNPS/ 
OPTION 3 4 
STATISTICS 1 
REGRESSION DESCRIPTIVES/ VARIABLES=NPSG NAG ECL TOEFL/ 
DEPENDENT=NPSG/ENTER/STEPWISE/ 
RES IDUALS=DEFAULT/ 
SCATTERPLOT (*RES ,*PRED) / 
CASEWISE=DEFAULT ALL/ 
SAVE=SEPRED (SE)/ 
PLOT CUTPOINTS=EVERY (36) / 
PLOT=NPSG WITH ECL/ 
PLOT=NPSG WITH NAG/ 
PLOT=NPSG WITH TOEFL/ 
FINISH 
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APPENDIX B. PROGRAM RESULT 


A. OUTCOME OF NA GRADE 


NA Grade 


B. OUTCOME OF ECL TESTING SCORE 


ECL Score 








NPS Grade 
COUNT I 
ROW PCT I 
COL PCT [I 2.75 = 3.15 - 3.30 = 3.465 = 
I 3.16 I 3.2 I 3.44 [ 3485 I 
Oe ree oe ce (eee ee Ed 
2.75 - [ 8 I 8 I! host I 
3.14 I 467.1 1 67.r% f 5.9" f{ I 
I 650.0 ! 72.7 { 20.0 f I 
Wee co: cease wena Owe ames (eae © 
3.15 - I 7 YT sont re I 
sae I 63.6 1. 27.3 ! $.i 1 I 
I 63.8 {§ 27.3 If 20.0 ! I 
Qe ep perme Cee oc meee 0 eee oo eee Oe eee Oo 
3.30 - I r ft I I tI Dt 
3.46 TU Ssas04 I 33.5 f£ 33.3 I! 
I 6.3 I I 26.0 { <5.0 55 
Owens wee Jee eee Oe Se Cae eee & 
3.45 - I I I a > if 
3.85 I I I 40.0 1% 60.0 1? 
I I I 40.0 !% 75.0 1! 
eerwe eee Gewese ae Owe oe eee Oe oe @ 
COLUMN 16 lI 5 4 
TOTAL 446.4 30.6 13.9 Tr.1 
NPS Grade 
COUNT 1! 
ROW PCT I 
COL PCT [ 2.75 = 3.15 - 3.30 = 3.45 - 
I 3.146 ) OR I 3.44 I 3.85 I 
nn ead 
I Sor eet I I 
$0 - 81 § 75.0 ff 25.0 I I I 
I 8.8 I 2 ee I I 
& we Gee ae Ore Ss Se ee Oe See & 
I feud Se I I! I 
82-84 1 75.90 © 18.8 1! 6.3 1 I 
I 75.0 1 27.3 £ 220.9 [ I 
ere ee ee = we eos Coens + 
I 1 ! if Loe Lae 
85 - 88 I 10.0 ££ 70.0 I 10.0 ££ 10.0 f 
I 6.3 I 63.6 1! 20.0 1% 25.0 I 
o o a 
I I I S75 sat 
89 = 92 I I r s0.0 © $0.0 I! 
I I r 60.0 © 75.0 ! 
Qeaeeewace (ewe wee = Gee e ome e Coe ee ee oe © 
COLUMN 16 ql 5 4 
TOTAL 44.4 30.6 13.9 1r.f 
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ROW 
TOTAL 


1? 
467.2 


ql 
30.6 


36 
100.0 


ROW 
TOTAL 


Ir.! 


16 
44.4 


To 
27.8 


16.7 


36 
100.0 


C. OUTCOME OF TOEFL TESTING SCORE 


TOEFL Scorem------—* 














NPS Grade 
COUNT I 
ROW PCT I ROW 
cou PCT I 2.75 = 3.15 = 3.30 =- 5.45 = TOTAL 
I 3.14 I 3.29 I 3.44 loS2e5 I 
ww ew eee (ewww woe (eee © 
I 4 I a! I I 6 
70 - 746 I 66.7 I 33.35 I I I 16.7 
I 25.0 I 18.2 I! I I 
(wee wee eee & C eee ee oy 
I 6 I 1 I 2 tI I 7 
78 - 79 I 87.1 I 146.3 I 28.6 I I 19.4 
I 28.0 I 9.1 I 40.0 I I 
Con oe wee Oe Jeweweees see ewe eo ew = 
I s ! 8 6! oe I 18 
80 - 841 44.6 1 464.6 1 ILl.l I I $0.0 
I §0.0 I 72.7 I 40.0 I T 
ewes toeweewe «es (ewe wwewe oe Oe eer ee > 
I I I 1 I a | 5 
85 - 90 I I I 20.0 [ 80.0 [I [379 
I I I 20.0 fF 100.0 f 
bdewwoeeees. ¢ eeweewwes (eee wweee woe eweeo cd 
COLUMN 16 et 5 & 36 
TOTAL 44.4 30.6 13.9 11.1 100.0 


D. PLOT OF NPS GRADE WITH ECL TESTING SCORE 


@®eae%w% @e 


f 


es 
e® @e see ee ezeeee##e 


3.373 
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Gch. Testing feore 


E. PLOT OF NPS GRADE WIHT NA GRADE 


@2eaee%re aye: 


» @ ov E 


a 
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3.a79e . 
8 1 0 
a a 
‘ ‘ 
6 e 
3.79¢ g 
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8 e 
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e e 
a t 6 
$.s3¢ t e 
a t 388 8 
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8 1 t 0 
F] 1 t 1 
8.izge il a3 
‘ 1 
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e I I t 8 
a t 8 t 
ge 
a t t ‘ 
a 
—_— Gene Ge Gee Ces Ce ne Oe Ge Cee GES GEE Geese Ge Gee Seana OD 
3.8 2.94 3.12 3.38 3.44 3.6 3.76 3.92 
2.72 2.08 3.06 3.2 3.36 3.32 3.68 3.86 
a Oreee 


ane eee 








8 & 
s a 
3.arde e 
1 t e 
‘ a 
a 6 
‘ 8 
8.73 1 e 
a e 
@ e 
8 t 4 
4 6 
8.459¢ « 
4 6 
a e 
& & 
8 6 
3.$¢ e 
a 5 
8 e 
8 6 
4 6 
8.379 3 e 
‘ 1 t t e 
a t 6 
4 e 
8 1 
3.23¢ I 

6 1 I t 6 
8 e 
a 1 t 6 
6 1 t 1 ® 
$.i2$e 1 t % t e 
1 % 6 
5 t t \ 8 
8 1 t e 
‘ t t t e 
te * 
a t 1 e 
8 6 
1 e 

SS eC SS ee 
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